Tunvmm'n^Mnun^n'ii1.' w .< ww v i in  wm pji ^ji  »j »j ■» ■ »■  t»  v* vw v^u ■ 


£ 


V 


AFOSR.TR.  8  7  -  2  0  1  6 


Statistical  Inference  for  Stochastic  Processes 


Final  Technical  Report  for  AFOSR  Grant  Number  82-0029 

1  January  1982  —  31  December  1986 


Alan  F.  Karr 

Department  of  Mathematical  Sciences 
G.W.C.  Whiting  School  of  Engineering 
The  Johns  Hopkins  University 
Baltimore,  Maryland  21218 


October  15,  1987 


>  n 


[Pll  Redacted] 


7^~.  v;  w-7  r  _ 


t  I  ’  •  "«  »  »  <-i  At-l’ 

t  V  .  •  Prj 
[ !  >1  i  £■■  ■  -  '■ 


la  REPORT  SECURITY  C 


2a.  SECURITY  CLASSIFICATION  A 


2b.  DECLASSIFICATION /OOWNG 


4  PERFORMING  ORGANIZATION  REPORT  NUMBE 


AD-A190  491 


nTtp  r  r  r  r> 
rILh  uui- 

PAGE 

3.  RESTRICTIVE  MARKINGS 


3,  DISTRIBUTION /AVAILABILITY  OF  REPORT 
Approved  for  public  rel aaso  ; 
distribution  unlimited.  _ 


Form  Approved 
OMB  No  0704-0188 


5.  MONITORING 


m'Wm  ^-20J6 


6a.  NAME  OF  PERFORMING  ORGANIZATION  16b.  OFFICE  SYMBOL  I  7a.  NAME  OF  MONITORING  ORGANIZATION 

I  (If  applicable)  ] 


Johns  Hopkins  University 


6c.  ADDRESS  (City,  State,  and  ZIP  Code) 
Baltimore,  MD  21218 


8a.  NAME  OF  FUNDING /SPONSORING 
ORGANIZATION 

AFOSR 


8c  ADDRESS  (City,  State,  and  ZIP  Code) 

AFOSR/NM 

Bldg  410 

H  1  1  '  n  Or 


1 1 .  TITLE  (Include  Security  Classification) 


AFOSR/NM 


7b  ADDRESS  (City,  State,  and  ZIP  Code) 

AFOSR/NM 
Bldg  410 
Bolling  AFB  D 


8b  OFFICE  SYMBOL  9  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 


(If  applicable) 
NM 


AFOSR-82-0029 


10.  SOURCE  OF  FUNDING  NUMBERS 


PROGRAM 


61102F 


PROJECT 

TASK 

NO 

NO 

2304 

A5 

WORK  UNIT 
ACCESSION  NO 


Statistical  Inference  for  Stochastic  Processes 


12.  PERSONAL  AUTHOR(S) 

Alan  F.  Karr 


13a.  TYPE  OF  REPORT 
Final 


16.  SUPPLEMENTARY  NOTATION 


14.  DATE  OF  REPORT  (Year,  Month.  Day)  15.  PAGE  COUNT 

Oct.  15,  1987  36 


COSATI  CODES 


SUB-GROUP 


18.  SUBJECT  TERMS  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 


19.  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

Research  under  this  grant  resulted  in  42  research  papers  and  one  book  topics  of  the 
research  included  state  estimation  for  Cox  processes  inference  for  stationary  point  processes 
inference  for  multiplicative  intensity  model  inference  for  thinned  point  processes,  inference 
for  0-1  Mackob  processes,  and  inference  for  stationary  random  fields. 


20  DISTRIBUTION /AVAILABILITY  OF  A8STRACT 

□  UNCLASSIFIED/UNLIMITED  □  SAME  AS  RPT  □  OTIC  USERS 


DO  Form  1473,  JUN  86 


21  ABSTRACT  SECURITY  CLASSIFICATION 


22c  OFFICE  SYMBOL 


Previous  editions  are  obsolete.  ,  ,  iE^y|IITy  CLASSiFiC^LiON  OF  THi 

t 

Vir  *  .  •»*  <*>  i  I 


OF  THIS  PAGE 


,rV .  ..  »  n.-m  .inni'r^rvi"iu'i'rv.|.nmM..j  r..Vrj  «  .  »■.  wj  <r,  v.-  vj  y?  ir.’f.'  r.'ifv  ipj  «y,'Tir_'yr*’ 


CONTENTS 


Summary  . 1 

Principal  Research  Accomplishments  . 3 

Work  in  Progress  as  of  December  31,  1986  . 20 

List  of  Publications  . 23 

Doctoral  Dissertations  . 25 

Curriculum  Vita  —  Alan  F.  Karr  . 26 


Summary 


This  is  the  final  technical  report  for  Air  Force  Office  of  Scientific  Re¬ 
search  grant  number  82-0029,  ‘Statistical  Inference  for  Stochastic  Pro¬ 
cesses,’  for  the  period  January  1,  1982  -  December  31,  1986.  During  this 
time,  a  research  program  of  high  international  visibility  and  impact  was 
conducted,  which  resulted  not  only  in  numerous  publications  —  including 
the  highly  regarded  book  Point  Processes  and  their  Statistical  Inference  — 
but  also  in  many  scientific  visits,  conference  addresses  and  seminar  presen¬ 
tations. 

The  principal  research  accomplishments  may  be  grouped  and  summa¬ 
rized  as  follows: 

•  Inference  for  Point  Processes 

-  State  estimation  for  Cox  processes  with  unknown  law 

*  Mixed  Poisson  processes:  publication  [3] 

*  General  Cox  processes,  nonparametric  models:  publication 

[5| 

*  General  Cox  processes,  parametric  models:  publication  [12] 

-  Inference  for  stationary  point  processes 

*  Estimation  of  Palm  distributions:  publications  [1]  and  [9] 

*  Estimation  of  distributions:  publication  [9] 

*  State  estimation:  publication  [9] 

-  Inference  for  multiplicative  intensity  models 

*  Maximum  likelihood  estimation  using  the  method  of  sieves: 
publication  [10] 

-  Inference  for  thinned  point  processes 

*  Nonparametric  estimation:  publication  ['ll 

*  State  estimation:  publication  [l] 

•  Inference  for  0-1  Markov  processes 

-  Parameter  estimation:  publications  [l]  and  [2] 


-  State  estimation:  publication  [2] 

-  Combined  inference  and  state  estimation:  publication  [2] 
Inference  for  stationary  random  fields 

-  Nonparametric  estimation  of  covariances  and  spectra  from  Pois¬ 
son  samples:  publication  [6] 

Additional  topics 

-  Poisson  approximation:  publications  [  1 1  ]  and  [13] 

-  Properties  of  randomized  stopping  times  for  Markov  processes: 
publication  [8] 

-  Nonparametric  survival  analysis:  publication  [12] 

-  Applications  of  the  Cox  regression  model:  publication  [7] 
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Principal  Research  Accomplishments 


State  estimation  for  Cox  processes.  A  simple  point  process  JV  and 
diffuse  random  measure  M  (on  the  same  space  and  defined  over  the  same 
probability  space)  comprise  a  Cox  pair  if  conditional  on  M,  N  is  a  Poisson 
process  with  mean  measure  M.  We  say  also  that  N  is  a  Cox  process  (or 
doubly  stochastic  Poisson  process)  with  directing  measure  M. 

In  applications  ranging  from  signal  detection  to  image  analysis  to  mod¬ 
eling  of  precipitation,  the  directing  measure  is 

•  Of  primary  physical  importance 

•  Not  observable. 


Rather,  only  the  Cox  process  N  is  observable,  and  one  seeks  to  reconstruct 
—  for  each  realization  w  and  with  minimal  error  —  the  value  M(u>)  from 
N(uj). 

The  optimal  state  estimators  are  conditional  expectations  £,[it/(-)|iV], 
which  are  themselves  random  measures.  More  generally,  the  entire  condi¬ 
tional  distribution  P{M  €  (-) ( jV}-  should  be  calculated.  In  [5]  a  complete 
solution  to  this  problem  is  derived. 

Theorem.  Let  N  be  a  Cox  process  with  directing  measure  M.  For 
each  set  A,  let 

7s [A)  =  o(N(B)  :  B  CA) 

be  the  a-algebra  corresponding  to  (complete,  uncorrupted)  observation  of 
N  over  A.  Then  provided  that  E\M{A)\  <  oo, 

(1) 

e=NA 

for  each  set  T,  where  the  are  unreduced  Palm  processes  of  M  (cf.  [1,5]), 
and  Na  is  the  restriction  of  N  to  A  (i.e.,  the  observations). 

It  follows,  for  example,  that  for  each  set  B, 


p{Me  r|J/v(A)}  - 


G  T)] 


E{e-M'‘W\ 


E\M{B)\7n(A)\ 


E\eM“^M^{B)\ 

E\e~M“W\ 
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However,  while  this  is  a  completely  general  solution  to  the  state  estima¬ 
tion  problem,  implementation  of  (1)  requires  knowledge  of  the  probability 
law  of  M  (or  of  TV  —  the  two  determine  each  other  uniquely),  which  is 
often  unavailable  in  practice.  In  [1,3,5,12)  we  address  various  facets  of  the 
problem  of  combined  inference  and  state  estimation  for  Cox  processes,  for¬ 
mulated  in  the  following  manner. 


1.  Suppose  that  E  is  compact  and  for  simplicity  that  A  =  E.  Let 
(TV,,  Mi),  i  =  1,2, ...  be  i.  i.  d.  (independent,  identically  distributed) 
copies  of  a  Cox  pair  ( N,M ),  such  that  the  TV,  are  observable  whereas 
the  M,  are  not.  Assume  that  the  law  of  M  is  unknown.  Suppose  that 
Nu...,Nn  have  been  observed  and  that  we  desire  an  approximation 
to  the  ‘true’  state  estimator  E\e~M"+l^^\ 7Vn+i]. 

2.  The  first  key  observation  is  that  for  each  function  /, 


£,[e-w"+1(/)|fVn+1] 


1  +  /) 
1) 


(2) 


where  LM(p,f)  —  E\e  MA!) J  js  the  Laplace  functional  of  the  Palm 
process  Mm. 

3.  Second,  a  key  lemma  in  [5]  establishes  that  ar  ‘he  reduced  Palm 
process  iVM,  which  satisfies 


P{N,  e  (•)}  =  P{N  -  n  e  (-)|JV  —  n  >  o},  (3) 

form  a  Cox  pair,  so  that  for  functions  g  with  0  <  g  <  1, 

L\f{n,g)  =  Ln(h,  -  log(l  -  ff)),  (4) 


where  is  the  Laplace  functional  of  TV (i. 

4.  We  now  invoke  the  principle  of  separation  long  used  in  electrical  en¬ 
gineering.  Since  by  (l)  and  (4), 


if  we  were  able  to  estimate  L n  we  could  use  the  pseudo-state  estima¬ 
tors 


PMn  +  l(f) 


l*»+i]  =  — 


LN{Nn+ 1,-  log/) 


LN(Nn+l,oo) 

where  L n  is  an  estimator  based  on  N\, . . . ,  Nn+i. 

5.  On  the  basis  of  (3)  we  construct  estimators 

t  ,  ,  E,"=,  n,'=,  WM*  >MA„,)) 

L'M~  D,"  ill!.!  1 1. ■  /.(.!,,»  '  (6) 

where  (v4n;)  is  a  null  array  of  partitions  of  E. 

These  estimators  have  been  shown  [5]  under  appropriate  hypotheses  to 


•  Strongly  uniformly  consistent 

•  Pointwise  asymptotically  normal; 
however,  principal  result  is  the  following. 

Theorem.  For  /  a  function  satisfying  0  <  /  <  1  and  6  >  0, 

Jim  n~l/2+6E  (£[eM"+,(/>|7Vn+1]  -  ,;)2j=0.  (7) 

While  very  general,  this  theorem  is  disappointing  in  the  sense  that  the 
rate  of  (L2-)convergence,  n~ 1/,<,  is  distinctly  less  than  one  would  wish  (based 
on  central  limit  theory,  the  hoped-for  rate  of  convergence  is  n~I//2).  In  [3] 
more  precise  results  we  obtained  for  mixed  Poisson  processes,  which  are  Cox 
processes  in  which  the  directing  measure  has  the  particular  form  M  —  Y u0, 
where  Y  is  a  positive  random  variable  with  unknown  distribution  F  and  u0 
is  a  fixed  (but  unknown)  measure  on  E.  In  this  case, 


E\e~M^\NA\ 


f  F{du)e-w"(A)uN(A)e-u^F 


1  '  f  F(du)e-u^uN^ 

and  special  structure  may  be  used  to  estimate  Vc,  and  the  integrals 


separately. 

Similarly,  in  [5]  we  stipulate  a  parametric  model  { P '$  :  6  E  0}  and  are 
able  to  obtain  optimal  rates  of  convergence  in  (7). 

Inference  for  Stationary  Point  Processes.  Let  N  be  a  point  pro¬ 
cess  on  (for  simplicity)  R/,  assumed  stationary  with  respect  to  translation 
operators  Qz'jJ  —  wr,'1,  where  Tzy  —  y  —  i,  (cf.  jlj)  and  suppose  that  the 
underlying  probability  measure  P  is  unknown.  The  data  comprise  single 
realizations  of  N  observed  over  compact,  convex  sets  K\  the  problems  of 
interest  are 

•  Estimation  of  moment  measures,  cumulant  measures  and  the  spectral 
measure  of  N 

•  Estimation  of  the  Palm  measure  P',  which  satisfies 

E  J  G(Nr-\x)N(dx)  =  £*  /  G{N,x)dx 

for  appropriate  functionals  G,  and  has  the  heuristic  interpretation 
that 

p’{n  e  r}/p*(n)  =  p{n  e  r|;v({o}f  =  1} 

•  Estimation  of  P 

•  ‘Large  sample’  behavior  of  estimators  as  K  f  R^. 

To  estimate  the  integral 

P*(P)  -  P*[/V(P)]  =  [  HdP *  (8) 

Jn 

we  use  the  unbiased  estimators 

F'(H)  =  JTk)Ik  H(Nr;‘)N(dr.).  (9) 

These  can  be  written  as 

c-(/0  =  t4,  E 


G 


so  that  P*(H)  is  simply  a  sum  of  evaluations  of  H  at  translations  of  X 
placing  each  point  in  turn  at  the  origin. 

Particular  choices  of  H  lead,  for  example,  to  estimators  of  reduced 
moment  measures.  Taking  H  =  1  yields  the  estimators  u  —  P’(l)  = 
N(K)/ X(K)  of  the  intensity  u  =  2?'[l].  Similarly,  taking  //(TV)  =  X(f), 
where  /  is  a  function  with  compact  support,  gives  the  estimators 

£*(/)  =  jK  N(dx)  f  f(y  -  x)^{dy)  (10) 

of  the  reduced  second  moment  measure  /if. 

Given  a  convex  set  K,  we  define  <§(//)  to  be  the  supremum  of  the  radii 
of  Euclidean  balls  that  are  subsets  of  K.  Assuming  that  <5 (K)  — ►  oo  allows 
K  to  grow  in  a  general  yet  nevertheless  restrained  manner;  in  particular, 
K  must  expand  in  all  directions,  although  not  necessarily  at  the  same  rate. 

The  main  result  on  strong  uniform  consistency,  proved  in  [9|,  improves 
previous  consistency  results  by  the  addition  of  uniformity. 

Theorem.  If 

a)  P  is  ergodic; 

b)  0  <  v  <  oo; 

c)  H  is  a  uniformly  bounded  set  of  functions  on  H  4,mt,  is  compact  in 
the  topology  of  uniform  convergence  on  compact  subset  ,,i  i 2 ; 

then  almost  surely 

lim  sup  -  P'(H)\  =  0.  (11) 

((Kj-oo  Hex 

Consequences  include  strong  uniform  consistency  of  the  estimators  fi2: 
for  K  a  compact,  uniformly  bounded  subset  of  C+(E),  each  element  of 
which  has  support  in  the  same  compact  subset  of  Rd, 

I™  sup  |£?(/)  -  nl(f)\  =0  (12) 

f(K)- oo 

almost  surely,  as  well  as  for  corresponding  estimators  of  the  spectral  mea¬ 
sure  and  spectral  density  function. 

Available  results  on  asymptotic  normality  are  rather  less  satisfactory, 
inasmuch  as  they  are  proved  only  under  very  strong  and  virtually  uncheck- 
able  assumptions,  using  classical  techniques  of  showing  that  cmnulants  of 
orders  three  and  greater  converge  to  zero. 

7 


v,  -v/.v -c. ’A  -\  ,  \  .  v.  -(W  -’.v.  v..-.  .\y  .\V ' 


Theorem.  If 

a)  P  is  ergodic; 

b)  Under  P,  moments  of  N  of  all  orders  exist; 

c)  All  reduced  cumulant  measures  of  N  have  finite  total  variation; 
then  for  each  H, 

((limKV/AW(p-(tf)-P'(ff)]  ijv(0,a!(//)),  (13) 

where  the  variance  cr2(H)  depends  on  P. 

The  full  force  of  the  strong  uniform  consistency  established  in  (11)  is 
used  in  [9]  to  prove  pointwise  consistency  for  estimators  of  the  probability 
P  itself.  Assumimg  that  the  intensity  u  is  known  we  use  as  estimators  of 
P(H)  =  E[H(N)), 

P{H)= L N[dx)  L  H^Nr‘-<yy  (») 

Theorem.  Assume  that  P  is  ergodic,  that  0  <  v  <  oo  and  that  H  is 
bounded  and  continuous.  Then  almost  surely 

„lr«|Aw-/>wl=0-  (l5) 

Additional  issues  addressed  in  [9]  include 

•  Poisson  approximations  complementing  the  central  limit  theorem 

•  Linear  state  estimation  when  the  probability  P  is  unknown. 


Inference  for  multiplicative  intensity  models.  Let  N^l\ 

...be  independent  copies  of  a  point  process  N  on  [0,1]  whose  stochastic 
intensity,  under  the  probability  measure  Pa,  is  A(o)(  =  a<A(,  where  A  is 
an  predictable  process  and  a  is  an  unknown  element  of  L+[0, 1].  Both  the 
and  the  baseline  stochastic  intensities  A*')  are  observable,  and  goal  is 
to  estimate  the  deterministic  factor  a. 

Given  the  data  (TV*1),  A^1*),. . . ,  (N^n\  A^"*),  the  log-likelihood  function 

Ln[a)  -  j  A"(l  -  a„)ds  +  f  (log  af)dN?,  (16) 

J  n  d  r\ 


*.  V  \  ■. 


where  Nn  =  £t=1  N (,)  and  An  -  V.^i  At‘>,  is  unbounded  above,  rendering 
direct  estimation  of  a  by  maximum  likelihood  techniques  impossible. 
Martingale  estimators,  one  attractive  alternative,  estimate  processes 


Bt(ci)  =  j  ft,  1  (A,  >0 )ds, 


which  are  surrogates  for  indefinite  integrals  ft  afds ,  via 


Bt  =  i  1(A,  >  OUr^JV,. 

J  r\ 


Martingale  estimators  are  easy  to  calculate,  as  are  their  variances,  which 
can  likewise  be  estimated.  Moreover,  potent  martingale  central  theorems 
may  be  applied  to  establish  asymptotic  normality  of  the  estimators.  Despite 
all  this,  martingale  estimators  admit  shortcomings  nevertheless,  arguably 
the  most  severe  of  which  is  that  they  do  not  estimate  a  itself  but  rather 
the  indefinite  integrals  in  (17). 

We  employ  the  method  of  sieves,  developed  by  Grenander  and  others. 
In  our  setting,  it  operates  in  the  following  manner:  let  I  =  L^[0, 1]  be  the 
index  set  of  the  statistical  model,  and  let  the  log-likelihood  functions  Ln  be 
given  by  (16).  For  sample  size  n,  we 

•  Replace  /  by  a  compact  subset  /„,  over  which  acre  does  exist  a 
maximizer  a  =  an  of  Ln ; 

•  Let  the  restrictions  become  successively  weaker  as  more  data  is  ob¬ 
tained. 

Given  proper  balancing  of  the  rate  at  which  the  In  increase  with  n,  these 
estimators  a  are  consistent. 

More  precisely,  for  each  a  >  0,  let  1(a)  be  the  family  of  absolutely  con¬ 
tinuous  a  €  I  such  that  a  <  a  <  a~l  and  |af|/a  <  a_t.  These  are  suitable 
restrictions  of  /;  the  sieve  mesh  a  measures  the  roughness  of  elements  of 
1(a).  Then  the  following  theorem  [lOj  indicates  how  a  should  depend  on  u. 

Theorem.  Assume  that 

a)  The  function  m,(a)  =  ^a[A,j  is  bounded  and  bounded  away  from 
zero  on  [0,  l]; 


b)  The  ‘entropy’ 

H(a)  =  -  /  [1  -  a,  +  a,  log(a4)]ms(a)ds 
•'o 

is  finite; 

c)  Jq  Va.Ta(\,)ds  <  oo; 

d)  £a[JV*)  <  oo. 

Then  for  each  n  and  a  there  exists  a  maximizer  d(n,a)  of  Ln  within  1(a) , 
and  for  an  —  n~l^4+r>  with  0  <  r?  <  1/4,  the  estimators  d  =  a(n,an)  satisfy 

lim  ||  d  -  a  ||i=  0  (18) 

n — »oo 

almost  surely  with  respect  to  Pa. 

Local  asymptotic  normality  of  log-likelihood  processes 

Ln(a,t)  =  J  A"(l  -  a,)ds  +  f  (log  a,)dN? 
o  o 

can  be  established  as  well;  it  is  of  interest  in  its  own  right  and  also  leads  to 
a  central  limit  theorem  for  the  integrated  estimation  error. 

Theorem.  Let  a  and  a*  be  elements  of  I  such  thal 

f'\i^l}m.(a)ds<  cc 
Jo  [  a, 

and 

I  — m,(a)ds  <  oo. 

Jo  [  ala, 

Then  under  Pa  the  processes 

^Ln(a  +  n~1/2a*,t)  -  Ln(a,t)  +  ^  m,(a)dsj 


converge  in  distribution  to  a  Gaussian  martingale  with  (independent  incre¬ 
ments  and)  variance  function 


One  can  deduce  from  this  theorem  that  the  integrated  sieve  estimators 
—  interestingly  —  satisfy  the  same  central  limit  theorem  as  do  martingale 
estimators. 


Inference  for  thinned  point  processes.  Given  a  point  process  N  = 
Hi  £x,  and  a  function  p  with  0  <  p  <  1,  let  t/,  be  random  variables  such 
that 

•  the  £/,  are  conditionally  independent  given  N 


•  for  each  i,  P{Ut  =  If N)  =  1  -  P{U{  =  OjiV}  =  p(X1); 
then  the  point  process 

N'  =  E 

t 

is  called  a  p-thinning  of  N.  Heuristically,  points  of  N  are,  randomly  and 
independently,  either  retained  in  their  original  location  in  N1  or  else  deleted 
entirely;  a  point  of  N  at  x  is  retained  with  probability  p(x). 

Among  the  computational  relationships  between  N  and  N'  are  comple¬ 
mentary  expressions  for  the  Laplace  functionals: 


Ln'{ f) 
Ln{q) 


Ln(~  logfl  -p  +  pe  /j) 

r  (  ,  p-l  +  e'J 

LN'  -  log - 


If  p  is  known,  then  the  laws  of  N  and  N'  determine  eat.,  other  uniquely. 

When  the  underlying  process  N  cannot  be  observed,  but  only  the  p- 
thinning  N'  is  observable,  the  state  estimation  problem  for  N  is  to  recon¬ 
struct,  for  each  realization  w,  the  unobserved  value  N(u>)  from  the  obser¬ 
vations  The  probability  law  of  N  and  the  function  p  (and  hence  the 

law  of  N')  are  stipulated  to  be  known. 

Of  course,  since  N'  is  observed,  we  need  actually  only  reconstruct  the 
point  process  N  —  N'  o f  deleted  points.  In  the  following  result,  the  entire 
conditional  distribution  of  N'  given  N  —  N'  is  expressed  in  terms  of  the 
reduced  Palm  distributions  of  N. 


Theorem.  Let  N'  be  the  p-thinning  of  N,  and  let  Q{p,du)  denote  the 
reduced  Palm  distributions  of  N.  Then 

exp(-z/(-  Iog(  1  -  p))}Q(N' ,dv) 


P{N  -  N'  6  du\N'} 


/exp[  — p(—  log(I  -  p))\Q{N',di])' 


(19) 


In  other  settings,  estimation  of  p  and  the  law  of  N  from  observation 
of  i.  i.  d.  copies  TV,'  of  the  p-thinning  N'  may  be  the  principal  objective. 
We  have  done  this  in  a  completely  nonparametric  manner  as  follows.  Let 
{Anj  :  n  >  1,1  <  j  <  Cn}  be  a  null  array  of  partitions  of  E ;  then  under 
the  assumption  that  the  mean  measure  p  of  N  is  known  and  given  the 
observations  N[, . . . ,  N'n  we  use  the  estimators 


for  p  and 

L(g)  =  V  ^log  ,  (21) 

for  the  Laplace  functional  L  of  N,  where 

£’(/)  =  iEexp[-,v;(/)| 

n  i=i 


is  the  sequence  of  empirical  Laplace  functionals  associated  with  (N-). 
In  [4],  the  following  properties  of  these  estimators  are  established. 

Theorem.  Assume  that 

a)  p{x  :  p( x)  =  0}  =  0; 

b)  p  is  diffuse; 

c)  p  is  continuous  and  p(x)  >  0  for  all  x; 

d)  maxy  diam  An]  — ►  0; 

e)  E\N{E)A\  <  oo; 

f)  There  is  6  ^  1  such  tihd>l  cls  n>  ^  oo^ 

”  ,  1  n(A„,y  /_0(n)- 


Then  almost  surely 
and  for  each  compact  set  K  of  functions 


lim  sup|p(x)  -  p(x) j  =  0; 
n-,°°  x e£ 


(22) 


A  variety  of  other  results  appears  in  [  l]  as  well,  including  central  limit 
theorems  for  these  estimators. 

Inference  for  binary  Markov  processes.  Let  A'  =  ( A'<)  be  a  Markov 
process  with  state  space  S  —  {0, 1}  and  infinitesimal  generator 


where  a  and  b  are  positive  numbers,  possibly  unknown.  In  [2]  we  addressed 
issues  of 

•  Statistical  inference,  i.e.,  estimation  of  a  and  6 

•  State  estimation 

•  Combined  statistical  inference  and  state  estimation. 

for  X  under  a  wide  variety  of  forms  of  partial  observation.  These  include 

•  Regularly  spaced  discrete  observations  ArnA,  where  A  is  the  sampling 
interval 

•  ‘Jittered’  regular  samples  ArrtA+e„,  where  the  en  i.  i.  d.  random 
variables,  independent  of  A',  satisfying  |er„|  <  A/  * 

•  Poisson  samples  Xjn,  where  the  Tn  are  the  arrival  times  in  a  Poisson 
process  N  independent  of  X ,  whose  rate  may  be  unknown 

•  Poisson  samples  observable  only  when  Xt  =  1 

•  Observability  determined  by  an  alternating  renewal  process  indepen¬ 
dent  of  X 

•  Observation  of  only  the  ‘level  crossing’  times  U\,  IJ2.  ■  .  at  which  X 
enters  state  1 

•  Observation  of  the  time-averaged  data  Kn  =  Xtdt 

•  Observation  of  a  random  time  change  Z,  -  XTl. 


In  each  case,  ad  hoc  estimators  a  and  6,  which  exploit  the  special  struc¬ 
ture  of  the  problem,  are  devised,  and  shown  to  be  strongly  consistent  and 
asymptotically  normal,  and  optimal  state  estimators  A<  for  unobserved 
values  of  X  are  calculated,  either  explicitly  or  as  solutions  of  stochastic 
differential  equations.  Rather  than  present  an  exhaustive  list  of  results,  we 
illustrate  with  the  case  of  Poisson  samples  and  state  0  unobservable. 

Let  N  be  a  Poisson  process  with  arrival  times  Tn  such  that  A'  and  N  are 
independent,  and  suppose  that  a,  6  and  the  rate  A  of  N  are  all  unknown. 
Neither  X  nor  N  is  completely  observable;  instead  the  observations  are  the 
point  process 

N;  =  f*  X,dN„ 

whose  arrival  times  are  those  Tn  for  which  XT„  =  1.  It  is  known  that  this 
process  is  a  Cox  process,  and  also  a  renewal  process,  whose  interarrival 
distribution  F  satisfies 


1  -  F(u)]du  - 


a  +  b  +  a 

ot~  ■+■  q(o  +  b  +  A)  +  A  a 


In  particular,  (a,  6,  A)  is  uniquely  determined  by  the  three  values 

A  =  I  (l  -  F(u)}du 

Jo 

B  =  /  e-u[l  -  F(u)}du 

Jo 

C  =  i  e~2u[l  -  F(u)]du. 

With  Wk  denoting  the  interarrival  times  of  the  observed  renewal  process 
N\  appropriate  estimators  for  A,  B  and  C',  given  observation  of  N *  over 
[0,  t],  are  corresponding  functionals  of  the  empirical  distribution  function 
F  given  by 

H«)  =  N){t)  £  <  <*)•  (2-i) 

That  is, 


A  = 


[  1  -  F(u)\du  -- 


w-(0 


*•(<) 

E  wk 

k  1 


lV/V/V 


Lto  ** *•  —  *  to  *  toV  M  *_ 


bV.N  V  .V.N  .V  , 


'.V. 


we  arrive  at  estimators 

(a, 6, A)  =  H{A,B,C).  (25) 

Although  the  situation  is  rendered  more  complicated  by  the  presence 
of  the  ‘random  sample  size’  N‘(t)  in  (24),  limit  theory  for  empirical  dis¬ 
tribution  functions  can  nevertheless  be  applied  to  yield  the  following  large 
sample  properties  for  the  estimators  of  (25). 

Theorem.  As  n  — >  oo, 

(a,  6,  A)  — +  (a,  6,  A)  (26) 

almost  surely. 

Theorem.  As  n  — >  oo, 

yfii[{AtB,C)-{A,B,C)\  -iV(0,£), 

where  the  covariance  matrix  E  is  computed  in  [2],  and  hence 


:JS 

:* 


y/n  [(a, 6,  A)  -  (a, 6,  A)]  4  iV(JHEJ^), 


|| 


where  is  the  Jacobian  of  the  transformation  H. 

State  estimation  for  X  given  observations  Gt  —  o[N J  :  u  <  t)  of  N‘ 
entails  principally  solving  the  filtering  problem  of  calculating  the  optimal 
state  estimators 

Xt  =  E\Xt\gt).  (28) 


No  closed  form  solution  is  known;  however,  we  have  shown  that  the  process 
Xt  can  be  calculated  recursively,  as  the  solution  of  a  stochastic  differential 
equation. 

Theorem.  The  state  estimators  X  of  (28)  are  the  unique  solution  of 
the  stochastic  differential  equation 

dXt  =  [-6X,  +  a(l  -  X,)]  dt  +  (1  -  Xt_)  [dN;  -  X X,_dt]  .  (29) 

For  extension  to  general  Markov  processes  with  finite  state  space,  see 
[l,  Chapter  lOj. 

Inference  for  random  fields.  Let  Y  =  {F(x);x  6  R'1}  be  a  stationary 
random  field  on  Ra  with  unknown  mean 

m  =  £[F(x)j 

and  unknown  covariance  function 

R{y)  =  Cov(Y (x),  V (x  +  y)). 

Let  N  =  ]T,  £Xi  be  a  stationary  Poisson  process  on  Rd  with  (possibly 
unknown)  intensity  u,  and  assume  that  Y  and  N  are  independent.  We 
stipulate  that 

•  N  is  observable 

•  Y  is  observable  only  at  the  points  of  N. 

Thus  the  observations  are  the  marked  point  process 

N  =  ^e(x„y(x,))  (30) 

i 

over  sets  of  the  form  K  x  R,  where  K  is  compact  and  convex,  and  the 
principal  statistical  issues  are 

•  Estimation  of  m  and  R 

•  Large  sample  properties  of  estimators  as  f>{K)  — *  oo 

•  State  estimation  for  unobserved  values  of  Y . 
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This  model  is  applicable  in  a  wide  variety  of  situations;  its  principal  prop¬ 
erties  are  established  in  [6j. 

A  fundamental  question  is  whether  inference  is  even  possible  at  all;  that 
is,  does  the  law  of  N  determine  that  of  Y? 

Theorem.  If  Y  is  continuous  in  probability,  then  the  probability  law 
of  N  determines  uniquely  that  of  Y. 

Estimation  of  the  mean  value  m  is  straightforward,  even  if  is  is  unknown: 
the  appropriate  estimator  given  observation  of  N  over  A'xR  is 

;Ky<w  Lx,eKY(x,) 

N(K)  N(K)  ~  '  t31) 

Provided  that  the  covariance  function  R  is  integrable,  i.e., 


J  \R(y)\dy 


these  estimators  have  the  following  properties.  (Here  and  below,  Lebesgue 
measure  is  denoted  by  A  or  simply  by  dy.) 

Theorem.  If  (32)  holds,  then  the  estimators  m  of  (31)  are  consistent 
in  quadratic  mean:  as  6(K)  — ►  oo, 


E\(m  —  m)2]  — ♦  0 


and  asymptotically  normal: 


where 


\J\(K)(m  -  m)  N (0, a2), 

„’  =  {my)dy  +  m±"'l\. 


In  order  to  simplify  the  discussion  of  estimation  for  R  we  assume  that 
is  is  known;  however,  it  can  be  replaced  throughout  by  the  estimator  0  — 
N(K)/X(K). 

As  estimator  of  R  we  employ 

R{x)  =  „2xiK)  IkIkWk^X~Xi  +  r2)y{xi)y{^2)N(2](dx1,dxi),  (33) 


■'.v  ss. 


where  N^(dxudx2)  =  N{dxi){N  -  eXl)(dx2)  and  iuk(x)  =  adKw(x/aK), 
with  w  a  positive,  bounded,  isotropic  density  function  on  R'f  and  the  a/< 
positive  numbers  satisfying  a k  —>  0  and  adK\(K)  — *  oo  as  6(K)  — ►  oo. 

Weak  consistency  of  the  estimators  R  is  implied  by  the  following  result. 

Theorem.  Assume  that  R  is  continuous  and  fulfills  (32),  and  that  the 
fourth-order  cumulant  Q  of  Y  exists  and  satisfies 


sup  J  | Q(x  +  Xi,x,x2)\dx  <  oo. 


Then  as  6(K)  — *  oo, 


E[R(x)}  -  R{x) 


for  each  x  and 


\(K)adKCov(R(xl),  R{x2))  —  l(x,  =  ±X2)S(x,), 


where 


5(i)  = 


i/2[Q(0,x,x)  +  2R(x)2  +  R(0)7 


fw(y)2dy 

Asymptotic  normality  is  more  intricate. 

Theorem.  If  Y  has  finite  moments  of  all  orders,  if  for  each  k  the  /cth 
order  cumulant  function  Q ^  satisfies 

,  dz\ . . .  dzk-i  <  oo, 

if  R  is  twice  continuously  differentiable  and  if  /  \y\2w{y)dy  <  oo,  then  as 
S(K)  — ►  oo, 

yJ\(K)adK\R(x)  -  (x)]  4  AT(0, 5(x)),  (37) 

for  each  x,  where  5  is  given  by  (36). 

Additional  aspects  treated  in  [6]  include 

•  Construction  of  strongly  consistent  estimators  for  the  set-indexed  pro¬ 
cess  Q(A)  =  fA  R{x)dx 


•  Optimal  state  estimation  for  unobserved  values  of  Y,  using  linear 
state  estimators 

Y{x)  =  I  h(x,  z)Y (z)N(dz). 

K 

The  optimal  function  h  is  characterized  els  the  solution  to  a  particular 
integral  equation. 


19 


Work  in  Progess  as  of  December  31,  1986 

For  positron  emission  tomography  — -  an  increasingly  important  form 
of  medical  imaging  —  the  basic  model  is  that  observed  data  constitute  a 
Poisson  process  N  with  intensity  function 

p(u)  =  j  p(u|x)A(x)dx,  (38) 

where 

•  p  is  a  known  point-spread  function 

•  A  is  the  unknown  intensity  function  of  the  Poisson  process  of  positron- 
electron  annihilations. 

The  goal  is  to  estimate  A,  the  key  quantity  of  physical  interest. 

To  date  we  have  addressed  several  crucial  mathematical  issues,  albeit 
mainly  for  the  simplified  problem  of  estimating  the  unknown  intensity  func¬ 
tion  A  of  a  Poisson  process  N  (i.e.,  it  is  not  assumed  that  (38)  holds)  on 
d-dimensional  Euclidean  space  Rd .  These  include  the  following. 

1.  Given  as  data  i.  i.  d.  copies  N i,. . .  ,A'„  of  N,  define  the  superposition 
Nn  =  £,n=1  iV,;  Nn,  a  Poisson  process  with  intensity  function  nA,  and 
also  a  sufficient  statistic  for  A.  The  log-likelihood  function  (omitting 
a  term  not  dependent  on  A) 

Ln(  A)  =  —  n  J  A  (x)dx  +  J  [log  A(x)jAr"(dx),  (39) 

is,  however,  not  bounded  above,  and  therefore  does  not  admit  a  max¬ 
imizer. 

2.  The  method  of  sieves  provides  an  effective  means  of  approaching  the 

problem:  the  parameter  space  of  possible  intensity  functions  is  re¬ 
stricted  in  a  manner  that  becomes  successively  weaker  as  more  data 
is  obtained.  We  have  shown  that  maximizers  of  (39)  within  the 
restricted  sets  do  exist,  and  satisfy  desirable  statistical  properties. 
Specifically,  for  each  h  >  0  we  introduce  the  sieve  Sh  of  functions  A 
of  the  form  , 

A(x)  =  /  kh(x.  tj)F(dy), 


(40) 


where  h  is  a  smoothing  parameter,  kh  is  a  kernel  and  F  is  a  probability 
measure  on  Rd ,  but  is  otherwise  unrestricted.  (Note  the  resemblance 
between  (40)  and  (38)!)  We  have  taken  k^  to  be  a  circularly  symmetric 
Gaussian  kernel  with  variance  h: 

kh{x,y)  =  (27r/i)"i/2  expj  — ||x  -  y\\2 /2h}.  (41) 

The  smaller  h ,  the  rougher  A  can  be.  We  have  established  that  under 
minor  restrictions  on  the  kernels,  for  each  n  and  h  there  exists  a 
maximizing  element  F  —  F(n,h)  of  Ln,  which  under  (40)  becomes  a 
function  of  F. 

3.  Computation  of  the  restricted  maximum  likelihood  estimators  is  far 
from  straightforward.  Based  on  the  similarity  between  (38)  and  (40) 
and  on  the  ‘incomplete  data’  aspect  of  the  model,  we  have  investigated 
use  of  the  EM  algorithm  of  Dempster,  Laird  and  Rubin.  The  basic 
iteration  for  the  algorithm  is 

,  v  _  wj,  ,  v  f  kh(x,y)  Nn(dx) 

F  {  y)  F  [dy)]  fk/t(XtZ)Fo(dz)  Nn(Rdy  (42) 

where  F°  is  an  initial  estimate  and  Fl  the  new  estimate.  Although  we 
have  made  progress  regarding  convergence  of  this  infinite-dimensional 
iterative  algorithm,  our  results  remain  incomplete. 

4.  In  order  to  obtain  the  statistically  desirable  property  of  consistency 

for  estimators  , 

-M*)  =  =  J  kh(x,y)Fn{dy ) 

the  sieve  mesh  h  must  be  allowed  to  depend  on  the  sample  size  n  and 
in  particular  to  converge  to  zero  as  n  converges  to  infinity.  We  have 
proved  the  following  theorem. 

Theorem.  If 

a)  A  is  continuous  and  has  compact  support; 

b)  |  /  A(x)  log(A(x))dx|  <  oc; 

then  provided  that  hn  =  n~h®+'  for  some  e  >  0, 

l|  A(n,  hn)  A||,  — »  0  (43) 
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Deterministic  Functions,’  The  Johns  Hopkins  U  'f'rsitv,  January  1- 
December  31,  1982 

5.  Principal  Investigator,  Air  Force  Office  of  Scientific  Research  Grant 
82-0029A,  ‘Inference  and  Reconstruction  for  Stochastic  Processes  and 
Deterministic  Functions,’  The  Johns  Hopkins  University,  January  1- 
December  31,  1983 

6.  Principal  Investigator,  Air  Force  Office  of  Scientific  Research  Grant 
82-0029B,  ‘Inference  and  State  Estimation  for  Stochastic  Point  Pro¬ 
cesses,’  The  Johns  Hopkins  University,  January  1  December  31,  1984 

7.  Principal  Investigator,  Air  Force  Office  of  Scientific  Research  Grant 
82-0029C,  ‘Statistical  Inference  for  Stochastic  Point.  Processes,’  The 
Johns  Hopkins  University,  January  1 -December  31,  1985 


8.  Principal  Investigator,  Air  Force  Office  of  Scientific  Research  Grant 
82-0029D,  ‘Statistical  Inference  for  Stochastic  Processes.’  The  .Johns 
Hopkins  University,  January  1-Deceinber  31,  1986 

9.  Co-investigator,  Office  of  Water  Research  and  Technology,  Depart¬ 
ment  of  the  Interior,  Grant  14-34-0001-0407,  ‘Policy  Analysis  of  Reser¬ 
voir  Operation  in  the  Potomac  River  Basin,’  The  Johns  Hopkins  Uni¬ 
versity,  January  1-December  31,  1979  (with  J.  L.  Cohon,  C.  S.  ReV- 
elle) 

10.  Co-administrator,  Office  of  Naval  Research  Grant  NR-042-489,  ‘Re¬ 
search  Conference  on  Queueing  Networks  and  Applications,'  The  Johns 
Hopkins  University,  April  1,  1982-March  31,  1983  (with  R.  J.  Serfling) 

11.  Co-administrator,  Office  of  Naval  Research  Grant  N00014-85-G-01 17, 
‘Research  Conference  on  Combinatorial  Aspects  of  Matrix  Analysis,’ 
The  Johns  Hopkins  University,  February  1,  1985  January  31,  1986 
(with  R.  J.  Serfling) 

Professional  Activities 

Member,  American  Mathematical  Society,  American  Soci  tor  f  n^meering 
Education,  American  Statistical  Association,  Bernoulli  .  ociety  for  Math¬ 
ematical  Statistics  and  Probability,  Institute  for  Mathematical  Statistics, 
Operations  Research  Society  of  America,  Society  for  Industrial  and  Applied 
Mathematics 

Associate  Editor,  Operations  Research  Letters ,  1982-present 
Associate  Editor,  Mathematics  of  Operations  Research ,  1985-present 
Editor,  SIAM  Journal  on  Applied  Mathematics,  1985-present 
Referee,  Advances  in  Applied  Probability,  Annals  of  Probability,  Annals  of 
Statistics,  IEEE  Transactions  on  Information  Theory,  Journal  of  Geo¬ 
physical  Research,  Journal  of  Multivariate  Analysis,  Management  Science . 
Mathematics  of  Operations  Research,  Operations  Research,  Scandinavian 
Journal  of  Statistics,  Stochastic  Processes  and  their  Applications  and  nu¬ 
merous  other  journals 


gt 


Proposal  reviewer,  Air  Force  Office  of  Scientific  Research,  Army  Research  Of¬ 
fice,  National  Science  Foundation,  Natural  Sciences  and  Engineering  Re¬ 
search  Council  of  Canada 

Editor,  Series  in  the  Mathematical  Sciences,  The  Johns  Hopkins  University 
Press 

Editor-at-Large,  Marcel  Dekker,  Inc. 

Manuscript  reviewer,  Birkhauser-Boston,  Springer- Verlag 

Founder,  Chesapeake  Bay-Deiaware  Bay  Regional  Probability-Statistics  Days 


Selected  Conference  Addresses 

Invited  address,  ‘A  partially  observed  Poisson  process,’  Ninth  Conference  on 
Stochastic  Processes  and  their  Applications,  Evanston,  IL,  August,  1979 
Contributed  address,  ‘State  estimation  for  Cox  processes  on  general  spaces,' 
Tenth  Conference  on  Stochastic  Processes  and  their  Applications,  Montreal, 
PQ,  August,  1981 

Contributed  address,  ‘Reconstruction  of  partially  observed  binary  Markov  pro¬ 
cesses,’  Eleventh  Conference  on  Stochastic  Processes  and  their  Applica¬ 
tions,  Clermont-Ferrand,  France,  June,  1982 
Invited  address,  ‘Nonparametric  inference  and  state  estimation  for  Cox  pro¬ 
cesses,’  Joint  Statistics  Meetings,  Cincinnati,  OH,  Aug  1982 
Invited  address,  ‘Statistical  inference  and  state  estimatic  'r  binary  Markov 
processes,’  Joint  ORSA/TIMS  National  Meeting,  Chicago,  IL,  April,  1983 
Invited  lectures,  ‘Inference  for  point  processes  and  Markov  processes,’  Humboldt 
Universitat,  Berlin,  DDR,  May,  1983 

Invited  lectures,  ‘Inference  for  point  processes,’  Summer  School  in  Probability, 
Turku,  Finland,  June,  1983 

Invited  lectures,  ‘Inference  for  point  processes,’  University  of  North  Carolina 
at  Chapel  Hill,  October-December,  1983 
Invited  address,  ‘Inference  for  stationary  point  processes,’  Mini-Conference  on 
Inference  for  Stochastic  Processes,  Lexington,  KY,  May,  1981 
Invited  lecture,  ‘Inference  for  stationary  point  processes,’  University  of  Copen¬ 
hagen,  Denmark,  June,  1981 

Contributed  address,  ‘Maximum  likelihood  estimation  in  the  multiplicative 
intensity  model’  Fourteenth  Conference  on  Stochastic  Processes  and  their 
Applications,  Goteborg,  Sweden,  June,  1981 
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Invited  address,  ‘Estimation  of  Palm  measures  of  stationary  point  processes,’ 
Ecole  Polytechnique,  Paris,  June,  1984 

Invited  address,  ‘Inference  for  Stochastic  Processes:  A  Survey,'  (with  R.  J. 

Serfling)  Joint  Statistics  Meetings,  Las  Vegas,  NY,  August,  1985 
Contributed  address,  ‘Statistical  inference  for  stationary  random  fields  based 
on  Poisson  samples,’  45th  Session  of  the  International  Statistical  Institute, 
Amsterdam,  Netherlands,  August,  1985 
Contributed  address,  ‘Combined  inference  and  state  estimation  for  Cox  pro¬ 
cesses:  the  parametric  case,’  Satellite  Meeting  on  Mathematical  Statistics 
and  Probability  to  the  45th  Session  of  the  ISI,  Maastricht.  Netherlands, 
August,  1985 

Invited  address,  ‘State  estimation  for  Cox  processes,’  Research  Workshop  on 
Asymptotic  Statistical  Inference,  Edinburgh,  Scotland,  June,  198G 
Invited  address,  ‘Estimation  of  intensity  functions  of  Poisson  processes  via  the 
method  of  sieves,  with  application  to  positron  emission  tomography,-  (with 
M.  I.  Miller,  D.  L.  Snyder),  Joint  Statistics  Meetings,  Chicago,  August, 
1986 

Invited  address,  ‘Estimation  of  intensity  functions  of  Poisson  processes  via 
the  method  of  sieves,  with  application  to  positron  emission  tomography,' 
Mathematisches  Forschungsinstitut  Oberwolfach,  FRC,  w'«6 
Invited  lectures,  ‘Statistical  problems  arising  in  image  analy  .  oummer  School 


in  Probability,  Lahti,  Finland,  June,  1987 
Invited  address,  ‘Palm  distributions  of  point  processes  and  their  applications 
to  statistical  inference,’  AMS/IMS/SIAM  Joint  Research  Conference  in  the 
Mathematical  Sciences,  Ithaca,  NY,  August,  1987 
Invited  address,  ‘Maximum  likelihood  estimation  in  the  multiplicative  inten¬ 
sity  model,  via  sieves,’  Satellite  Meeting  on  Mathematical  Statistics  and 
Probability  to  the  46th  Session  of  the  ISI,  Kyoto,  Japan,  September,  1987 


Doctoral  Students 

James  A.  Smith,  ‘Point  Process  Models  of  Rainfall,’  1980  (with  J.  L.  Co- 
hon)  (currently  at  Interstate  Commission  for  the  Potomac  River  Basin, 
Rockville,  MD) 

David  M.  Zucker,  ‘Survival  Data  Regression  Analysis  with  Time-Dependent. 
Covariate  Effects,’  1986  (currently  at  National  Heart,  Lung  and  Blood  In- 
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stitute,  Bethesda,  \1D) 

Edward  L.  Chornoboy,  ‘Maximum  Likelihood  Techniques  for  the  Identifica¬ 
tion  of  Neural  Point  Processes,’  1986  (with  L.  P.  Schramm)  (currently  at 
Washington  University,  St.  Louis) 


Selected  Teaching 

Introduction  to  Engineering  (2  times) 

Introduction  to  Probability 
Introduction  to  Statistics  (2  times) 

Elementary  Stochastic  Processes  (2  times) 

Modern  Algebra  for  Applications 
Probability  Theory  (7  times) 

Stochastic  Processes  I  (6  times) 

Statistical  Theory 

Topics  in  Probability:  Image  Analysis 
Analysis  and  Probability  (6  times) 

Topics  in  Applied  Mathematics:  Approximation  Theory 
Applied  Probability  Models 
Stochastic  Processes  II  (2  times) 

Diffusion  Processes  (2  times) 

Brownian  Motion  and  Potential  Theory 
Random  Measures  and  Point  Processes  (2  times) 
Inference  for  Point  Processes  (2  times) 

Stochastic  Processes  for  Inference 
Inference  for  Stochastic  Processes  (2  times) 

Inference  for  Diffusion  Processes 


Book 


: 
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1.  Point  Processes  and  their  Statistical  Inference  (Marcel  Dekker,  New 
York,  1986). 


Research  Papers 
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1.  Weak  convergence  of  a  sequence  of  Markov  chains.  Z.  W  ahrschein- 
lichkeitstheorie  und  verw.  Geb.  33  (1975)  11  18. 

2.  Two  models  for  optimal  allocation  of  aircraft  sorties  (with  J.  Bracken, 
J.  E.  Falk).  Opns.  Res.  23  (1975)  979-995. 

3.  Stability  of  one-dimensional  systems  of  colliding  particles.  J.  Appl. 
Prob.  13  (1976)  155-158. 

4.  Two  extreme  value  processes  arising  in  hydrology.  J.  Appl.  Prob.  13 
(1976)  190-194. 

5.  The  role  of  Maxwell-Boltzmann  and  Bose-Einstein  statistics  in  point 
pattern  analysis  (with  A.  M.  Liebetrau).  Geographical  Anal.  9  (1977) 
418-422. 

6.  Levy  random  measures.  Arm.  Probability  6  (1978)  57-71. 

7.  The  inverse  balayage  problem  for  Markov  chains  (with  A.  O.  Pit- 
tenger).  Stochastic  Process.  Appl.  7  (1978)  165-178. 

8.  Markov  chains  and  processes  with  a  prescribed  invariant  measure. 
Stochastic  Process.  Appl.  7  (1978)  277-290. 

9.  Derived  random  measures.  Stochastic  Process.  ..,  pl.  8  (1978)  159- 
169. 

10.  An  inverse  balayage  problem  for  Brownian  motion  (with  A.  O.  Pit- 
tenger).  Ann.  Probability  7  (1979)  186 -191. 

11.  Classical  limit  theorems  for  measure-valued  Markov  processes.  J. 
Multivariate  Anal.  9  (1979)  234-247. 

12.  The  inverse  balayage  problem  for  Markov  chains,  II  (with  A.  O.  P  it  - 
tenger).  Stochastic  Process.  Appl.  9  (l 979)  35  53. 

13.  Some  inverse  problems  involving  conditional  expectations.  Multi¬ 
variate  Anal.  11  (1981)  17  39. 


14.  Natural  clades  differ  from  ‘random'  dades:  simulations  and  analysis 
(with  S.  M.  Stanley,  P.  W.  Signor.  Ill,  and  S.  Lidgard).  Paleobiology 
7  (1981)  115  -127. 

15.  A  partially  observed  Poisson  process.  Stochastic  Process.  Appl.  12 
(1982)  249-269. 

16.  State  estimation  for  Cox  processes  on  general  spaces.  Stochastic  Pro¬ 
cess.  Appl.  14  (1983)  209-232. 

17.  Extreme  points  of  certain  sets  of  probability  measures,  with  applica¬ 
tions.  Math.  Opns.  Res.  8  (1983)  74-85. 

18.  Error  bounds  for  reconstruction  of  a  function  /  from  a  finite  sequence 
(sgn(/(t,)  4-  x,)))  (with  R.  J.  Serfling).  SIAM  J.  Appl.  Math.  43 
(1983)  476-490. 

19.  A  point  process  model  of  summer  season  rainfall  occurrences  (with  J. 
A.  Smith).  Water  Resources  Res.  19  (1983)  95-103. 

20.  Estimation  and  reconstruction  for  zero-one  Markov  processes.  Sto¬ 
chastic  Process.  Appl.  16  (1984)  219-255. 

21.  Combined  nonparametric  inference  and  state  e?  ation  for  mixed 
Poisson  processes.  Z.  Wahrscheinlichkeitstheone  und  verw.  Geb.  66 
(1984)  81-96. 

22.  The  martingale  method:  introductory  sketch  and  access  to  the  liter¬ 
ature.  Opns.  Res.  Lett.  3  (1984)  59-63. 

23.  Statistical  inference  for  point  process  models  of  rainfall  (with  J.  A. 
Smith).  Water  Resources  Res.  21  (1985)  73-79. 

24.  Inference  for  thinned  point  processes,  with  application  to  Cox  pro¬ 
cesses.  J.  Multivariate  Anal.  16  (1985)  368-392. 

25.  Integer  Prim-Read  solutions  to  a  class  of  target  defense  problems 
(with  S.  A.  Burr,  J.  E.  Falk).  Opns.  Res.  33  (1985)  726  745. 


26.  Nonlinear  response  to  sustained  load  processes  (with  K.  ('.  Chou,  R. 
B.  Corotis).  J.  Structural  F'ngg.,  ASCFlll  (1986)  112  167. 

27.  State  estimation  for  Cox  processes  with  unknown  probability  law. 
Stochastic  Process.  Appl.  20  (10861  1)6-131. 

28.  Parameter  estimation  for  a  model  of  space-time  rainfall  (with  J.  A. 
Smith).  Water  Resources  Res.  21  (198.6)  1261  1267. 

29.  Inference  for  stationary  random  fields  given  Poisson  samples.  Ai.lv. 
Appl.  I’rob.  18  (1986)  -106-122. 

30.  Flood  frequency  analysis  using  the  Cox  regression  model  (with  .1.  A. 
Smith).  Water  Resources  Res.  22  (198G)  890  890. 

31.  Structural  property’s  of  random  times  (with  A.  O.  Pittenger).  Pmbab. 
Th.  Rel.  Fields  72  (1986)  396-116. 

32.  Estimation  of  Palm  measures  of  stationary  point  processes.  Probab. 
Th.  Rel.  Fields  74  (1987)  66  69. 

33.  Maximum  likelihood  estimation  in  the  multiplicative  intensity  model, 
via  sieves.  Ann.  Statist.  15  (1987)  473  190. 

34.  Poisson  approximation  of  Bernoulli  point  processes  and  their  super¬ 
positions,  via  coupling  (with  R.  Serfling).  Stochastic  Process.  Appl. 
(to  appear). 

35.  State  estimation  for  Cox  processes  with  unknown  law:  parametric 
models.  Stochastic  Process.  Appl.  (to  appear). 

36.  Poisson  approximation  in  selected  metrics  by  coupling  and  semigroup 
methods  with  applications  (with  P.  Deheuvels,  1).  Pfeifer  and  R.J. 
Serfling).  J.  Statist.  Planning  Inf.  (to  appear). 


Review  and  Survey  Articles 


].  Lanchester  attrition  processes  ami  theater-level  combat  models.  In 
Mathematics  of  Conflict.  M.  Shnbik,  ed..  89-1  2b  (North-Uolland.  Am¬ 
sterdam,  1983). 

2.  Point  process,  stationary.  In  Encyclopedia  of  Statistical  Sciences. 

VII.  N.  L.  Johnson  and  S.  Kotz,  eds.,  15-19  (Wiley.  New  York,  1986). 

3.  Poisson  processes.  In  Encyclopedia  of  Statistical  Sciences ,  VII.  N.  L. 
Johnson  and  S.  Kotz,  eds.,  29-32  (Wiley.  New  York,  1986). 

•1.  Stochastic  point  process.  In  Encyclopedia  of  Statistical  Sciences. 

VIII.  N.  L.  Johnson  and  S.  Kotz,  eds.  (Wiley,  New  York) (to  ap¬ 
pear)  . 

5.  Markov  processes.  In  Handbook  of  Operations  Research  and  Manage¬ 
ment  Science ,  D.  P.  Hevman  and  M.  J.  Sobel,  eds.  (North-Uolland, 
Amsterdam)  (to  appear). 

6.  Martingales.  In  The  A'e w  Palgrave:  A  Dictionary  of  Economics ,  J. 
Eatwell,  M.  Milgate  and  P.  Newman,  eds.  (London.  Macmillan)  (to 
appear). 


Book  Reviews 

1.  Review'  of  Markov  Chains:  Theory  and  Applications  by  D.  Isaacson 
and  R.  Madsen.  SIAM  Rev.  20  (1978)  606  607. 

2.  Review  of  Infinitely  Divisible  Point  Processes  by  K.  Matthes,  J.  Ker- 
stan  and  J.  Mecke.  J.  Amer.  Statist.  Assoc.  75  (1980)  750-751. 

3.  Review  of  Stochastic  Processes  and  Integration  by  M.  M.  Rao.  SIAM 
Rev.  24  (1982)  238  239. 

4.  Review  of  A  Second  Course  in  Stochastic  Processes  by  S.  Karlin  and 
H.  M.  Taylor.  SIAM  Rev.  25  (19*51  2*0  2*1. 

5.  I  eview  of  Stochastic  Practises  b>  S.  M  Ho--.  SIAM  Rev.  26  (1981) 
4 ,0-449. 


6.  Review  of  Stochastic  Models  in  Operations  Research ,  I  ail'd  II,  by  1). 
P.  Herman  and  M.  J.  Sobel.  American  Scientist  72  (1984)  106  107. 

7.  Review  of  Random  Measures ,  3rd  ed.,  by  C).  Kallenberg.  J.  Amer. 
Statist,  ,4ssoc.  82  (1987)  316-347. 


Manuscripts  Submitted 

1.  Nonparametric  survival  analysis  with  time-dependent  covariate  ef¬ 
fects:  a  penalized  partial  likelihood  approach  (with  D.  M.  Zucker). 
(To  Ann.  Statist .,  10-86). 


